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I. INTRODUCTION: THE TRAVELING SALESMAN PROBLEM 

Due to the simphcity of its formulation and the complexity of its exact solution, the traveling salesman problem 
(TSP) has been studied for a very long time 1] and has drawn great attention from various fields, such as applied 
mathematics, computational physics, and operations research. The traveling salesman faces the problem to find the 
shortest closed tour through a given set of nodes, touching each of the N nodes exactly once and returning to the 
starting node at the end Hereby the salesman knows the distances d{i,j) between all pairs of nodes, 

which are usually given as some constant non-negative values, either in units of length or of time. The costs Ti. of 
a configuration a are therefore given as the sum of the distances of the used edges. If denoting a configuration as a 
permutation a of the numbers {I, . . . , N}, the costs can be written as 

n{a) = d{o{N), a{l)) + d{<j{i), a{i + 1)). (1) 

i=i 

A TSP instance is called symmetric if d{i,j) = d{j, i) for all pairs of nodes. For a symmetric TSP, the costs for 
going through the tour in a clockwise direction are the same as going through in an anticlockwise direction. Thus, 
these two tours are to be considered as identical. 

As the time for determining the optimum solution of a proposed TSP instance grows exponentially with the 
system size, the number TV of nodes, a large variety of heuristics has been developed in order to solve this problem 
approximately. Besides the application of several different construction heuristics Q , which were either specifically 
' designed for the TSP or altered in order to enable their application to the TSP, the TSP has been tackled with 
various general-purpose improvement heuristics, like Simulated Annealing '3) and related algorithms such as Threshold 

Simulated and 
Furthermore 



Accepting |5i, iQ| , the Great Deluge Algorithm L7i, t &i 9|| , algorithms based on the Tsallis statistic s 'IP*^- ^ 
Parallel Tempering (methods described in [Tllll2lll3lll4ll5j ). and Search Space Smoothing p^ll7lll8l |. 
Genetic Algorithms T?, '20', "211 , Tabu Search 22j and Scatter Search |22l |2^ , and even Ant Colony Optimization 
[2^ , Particle Swarm Optimization _2^ .26„ 21} i and other biologically motivated algorithms have been applied to 
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FIG. 1: The optimum solution of the ATT532 benchmark TSP instance containing the 532 AT&T switch locations in the United 
States of America: this benchmark instance is part of Roinelt's benchmark library TSPLIB95 [2fl||. The optimum solution was 
created with the Searching for Backbones algorithm ^30.. .3L |. making use of the Lin-2-Opt and the Lin-3-Opt, which are shown 
in Figs. El and m 

the TSP. The quality of these algorithms is compared by creating solutions for benchmark instances, one of which is 
shown in Fig. ^ 

Most of these improvement heuristics apply a series of so-called small moves to a current configuration or a set of 
configurations. In this context, the move being small means that it does not change a configuration very much, such 
that usually the cost of the new tentative configuration which is to be accepted or rejected according to the acceptance 
criterion of the improvement heuristics does not differ very much from the cost of the current configuration. This 
method of using only small moves is called the Local Search approach, as the small moves lead to tentative new 
configurations, which are close to the previous configuration according to some metric like the Hamming distance for 
the TSP: the Hamming distance between two tours is given by the number of different edges. 

II. THE SMALLEST MOVES 
A. The Exchange 

One move which does not change a configuration very much is the Exchange (EXC), which is sometimes also 
called Swap and which is shown in Fig. |21 The Exchange exchanges two randomly selected nodes in the tour. Thus, 
from a proposed configuration, N x {N — l)/2 other configurations can be reached, such that the neighborhood of a 
configuration generated by this move has a size of order 0{N^). 



FIG. 2: The Exchange (left) and the Node Insertion Move (right) 




FIG. 3: The Lin-2-Opt 



B. The Node Insertion Move 

Another small move is the Node Insertion Move (NIM), which is also called Jump. It is also shown in Fig.|3 The 
Node Insertion Move randomly selects a node and an edge. It removes the randomly chosen node from its original 
position and places it between the end points of the randomly selected edge, which is cut for this purpose. The 
neighborhood size generated by this move is x (N — 2) and thus also of order 0{N'^). 

C. The Lin-2-Opt 

Lin introduced a further small move, which is called Lin-2-Opt (L20) js^ls^: as shown in Fig.O it cuts two edges 
of the tour, turns the direction of one of the two partial sequences around, and reconnects these two sequences in a 
new way. For symmetric TSP instances, only the two removed edges and the two added edges have to be considered 
when calculating the cost difference created by this move. For these symmetric TSPs, it plays no role which of 
the two partial sequences is turned around when performing the move, due to the identical cost function value for 
moving through clockwisely or anticlockwisely. In the symmetric case, on which we will concentrate throughout this 
paper, the move creates a neighborhood of size N x (N ~ 3)/2 and thus of order 0{N^). Please note that a move 
cutting two edges after neighboring nodes does not lead to a new configuration, such that the neighborhood size is 
not N X (TV — l)/2, a false value which is sometimes found in the literature. 
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FIG. 4: The four possibilities how to change a tour with a Lin-3-Opt 



The Lin-2-Opt turned out to provide better results for the symmetric Travehng Salesman Problem than the Ex- 
change. The reason for this quality difference was explained analytically by Stadler and Schnabl. In their paper 
[s^ l- they basically found out that the results are the better the less edges are cut: the Lin-2-Opt cuts only two 
edges whereas the Exchange cuts four. But they also reported results that the Lin-3-Opt cutting three edges leads 
to an even better quality of the solutions than the Lin-2-Opt, what contradicted their results at first sight, but they 
explained this finding with the larger neighborhood size of the Lin-3-Opt. 

III. THE LIN-3-OPT 

The next larger move to the Lin-2-Opt is the Lin-3-Opt (L30): the Lin-3-Opt removes three edges of the tour and 
reconnects the three partial sequences to some new closed tour. In contrast to the smallest moves for which there is 
only one possibility to create a new tour, there are four possibilities in the case of the symmetric TSP how to create a 
new tour with three new edges with the Lin-3-Opt if each of the partial sequences contains at least two nodes. These 
four possibilities are shown in Fig.^ Please note that we count only the number of "true" possibilities here, i.e., only 
those cases in which the tour contains three edges which were not part formerly in the tour, as otherwise the move 
would e.g. only be a Lin-2-Opt. If one of the partial sequences contains only one node and the other two at least two 
nodes each, then only one possibility for a "true" Lin-3-Opt remains. If even two of the three partial sequences do 
only contain one node, then there is no possibility left to reconnect the three sequences without reusing at least one 
of the edges which was cut. Analogously, there is one possibility for the Lin-2-Opt, if both partial sequences contain 
at least two nodes each, otherwise there is no possibility. 

If looking closely at the four variants of the Lin-3-Opt in Fig. 01 one finds that the resulting configurations could 
also be generated by a sequence of Lin-2-Opts: for the upper left variant in Fig.^ three Lin-2-Opts would be needed. 
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whereas only two Lin-2-Opts would be sufficient for the other three variants. Thus, one might ask whether the Lin- 
3-Opt is necessary as a move as a few Lin-2-Opts could do the same job. However, due to the acceptance criteria of 
the improvement heuristics, it might be that at least one of the Lin-2-Opts would be rejected whereas the combined 
Lin-3-Opt move could be accepted. Thus, it is often advantageous also to implement these next-higher-order moves 
in order to overcome the barriers in the energy landscape of the small moves. 

Now the question arises how large the neighborhood size of a Lin-3-Opt is. Of course, it has to be of order 0{N'^), 
as three edges to be removed are randomly selected out of N edges. However, for the calculation of the exact number 
of possibilities one has to distinguish between the case in which all partial sequences contain at least two nodes each 
and the case in which exactly one partial sequence contains only one node. 

Please note that the Node Insertion Move, which was introduced earlier, is the special case of the Lin-3-Opt in 
which one of the partial sequences only contains one node. But in the special case that one of the two next nearest 
edges to the randomly chosen node is selected, the NIM corresponds to a Lin-2-Opt. As the number of cut edges 
of the NIM is 3, such that this move is basically a Lin-3-Opt, but as the neighborhood size of this move is of order 
0{N'^), this move is also sometimes called Lin-2.5-Opt. 

IV. HIGHER-ORDER MOVES 

One can go on to even higher-order Lin-/c-Opts: the Lin-4-Opt cuts four edges of the tour and reconnects the four 
created partial sequences in a new way. If every partial sequence contains at least two nodes, there are 25 possibilities 
for a true Lin-4-Opt to reconnect the partial sequences to a closed feasible tour. The neighborhood size of this move 
is of order ©(TV*). 

The Exchange, which was also introduced earlier, is usually a special case of a Lin-4-Opt. Only if the two nodes 
which are to be exchanged are direct neighbors of each other or if there is exactly one node between them, then the 
move is equivalent to a Lin-2-Opt. 

One can increase the number k of deleted edges further and further. However, by doing so, one gradually loses 
the advantage of the Local Search approach, in which, due to the similarity of the configurations, their cost values 
do not differ much. In the extreme, the Lin-iV-Opt would lead to a randomly chosen new configuration, the cost 
value of which is not related to the cost value of the previous configuration at all. Moving away from the Local 
Search approach, the probability for getting an acceptable new configuration among the many more neighboring 
configurations with cost values in a much larger interval strongly decreases due to the finite available computing time. 
When using the Local Search approach, it turns out that using the smallest possible move only is only optimal in 
the case of very short computing times. With increasing computing time, a well chosen combination of the smallest 
moves and their next larger variants becomes optimal. Here the optimization run has more time to search through a 
larger neighborhood. The next larger moves enable the system to overcome barriers in the energy landscape formed 
by the small moves only. Of course, one can extend this approach and also include moves with the next larger k and 
spend even more computing time. 

However, for some difficult optimization problems, an approach based on small moves and their next larger variants 
is not sufficient [s^. There indeed large moves have to be used. A successful approach here are the Ruin & Recreate 
moves, which destroy a configuration to some extent and rebuild it according to a given rule set. They work in 
a different way than the small moves, which completely randomly select a way to change the configuration. In 
contrast, the Ruin & Recreate moves contain constructive elements in order to result in good configurations. Also for 
problems like the TSP, for which small moves basically work, well designed Ruin & Recreate moves are superior to 
the small moves ,35]. However, the development of excellent Ruin & Recreate moves is rather difficult, it is indeed an 
optimization problem itself, whereas the application of the Local Search approach, which simply intends to "change 
the configuration a little bit" , is rather straightforward and also usually quite successful in producing good solutions, 
such that it is mostly used. 

Sometimes one needs to know the exact size of the neighborhood generated by the implemented moves for relating 
it to the available computing time or for tuning an optimization algorithm like Tabu Search. Naturally, one is aware 
of the neighborhood size of a Lin-fc-Opt being of order 0{N^). The aim of this paper is to provide exact numbers 
for the neighborhood size. For deriving the neighborhood size of the Lin-3-Opt and of even larger Lin-A:-Opts, we will 
start with the determination of the number of possibilities for reconnecting partial sequences to a complete tour with 
a true Lin-fc-Opt in Sec. There we will find laws how many possibilities exist depending on the number of partial 
sequences containing only one node and their spatial neighborhood relation to each other. Having this distinction at 
hand, we will calculate the corresponding numbers of possibilities for cutting the tour in Sec. IVII 
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TABLE I: Number of true Lin-fc-Opts if the TSP is symmetric and if every partial sequence contains at least 2 nodes 



k 


T{k) 





1 


1 





2 


1 


3 


4 


4 


25 


5 


208 


6 


2121 



V. NUMBER OF POSSIBILITIES FOR RECONNECTING THE TOUR WITH A LIN-fc-OPT 

A. Special case 

1. Number of overall possibilities 

For the calculation of the number of possibilities for reconnecting the tour, we want to start out with the special 
case that each partial sequence contains at least two nodes. A Lin-fc-Opt cuts the tour into k partial sequences. The 
overall number of possibilities to reconnect them to a closed tour containing all nodes can be obtained when imagining 
the following scenario: one randomly selects one of the partial sequences and fixes its direction. (This has to be done 
for the symmetric TSP for which a tour and its mirror tour are degenerate) This first partial sequence serves as a 
starting sequence for the new tour to be constructed. Then one randomly selects one out of the fc — 1 remaining 
partial sequences and adds it to the already existing partial tour. There are two possible ways of adding it, one for 
each direction of the partial sequence. Thus, one gets a new system with only fc — 1 partial sequences. The number 
of possibilities to construct a new feasible tour is thus given as 

P(fc) = 2(fc- l)P(fc- 1). (2) 

This recursive formula can be easily desolved to 

F(fc) = 2'=-i(fc- 1)!. (3) 

2. Number of true Lin-k-Opts 

However, this overall set of possibilities contains many variants in which old edges which were cut are reused in the 
new configuration, such that the move is not a true Lin-fc-Opt. Thus, in order to get the number of true Lin-fc-Opts, 
those variants have to be subtracted from the overall number. As there are (*^) possibilities to choose i old edges for 
the new tour if there were overall fc deleted edges, the number of true Lin-fc-Opts is given by the recursive formula 

T(fc) = 2'=-i(fc - 1)! - ^ ('^')T(i) withT(O) = L (4) 

The starting point of this recursion is T(0) = 1, as there is one possibility for the Lin-O-Opt, the identity move, 
in which no edge is changed. Table Ogives an overview of the numbers of true Lin-fc-Opts for small fc, in the case 
that each partial sequence contains at least two nodes and that the TSP is symmetric. We find that there is one 
Lin-O-Opt, the identity move, no Lin-l-Opt, as by cutting only one edge no new tour can be formed, one Lin-2-Opt, 
four Lin-3-Opts, and so on. In the case of an asymmetric TSP, each number here has to be multiplied by a factor of 
2. 



B. General case 

1. Number of overall possibilities 



In the general case, not every partial sequence contains at least two nodes. There might be sequences containing 
only one node which are surrounded by two sequences containing more than one node in the old tour. Furthermore, 
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there might be tuples of neighboring sequences containing only one node each which are surrounded by two sequences 
containing more than one node, and so on. 

Let ao be the number of the partial sequences containing more than one node, ai be the number of sequences 
containing only one node and surrounded by two sequences containing more than one node in the old tour, a-i be the 
number of tuples of one-node-sequences surrounded by two sequences containing more than one node in the old tour, 
as be the number of triples of one-node-sequences surrounded by two sequences containing more than one node in 
the old tour, and so on. We will see that P and T are no longer functions of k only, but depend on the entries of the 
vector a = (aoi c^ij • • •)• 

In the following, the assumption shall hold that not every edge of the tour is cut, such that k < N and > 0. 
Thus, one can always choose a partial sequence consisting of two or more nodes as a starting point for the creation of 
a new tour and fix its direction, as we only consider the symmetric TSP here. 

Starting with this fixed partial sequence, a new feasible tour containing all nodes can be constructed by iterativcly 
selecting an other partial sequence and adding it to the end of the growing partial tour. For the overall number of 
possibilities for construcing a new tour, it plays no role whether one-node-sequences were side by side in the old tour 
or not. Thus, the number of possibilities -P(<S) is simply given as 

P(a) = P(ao,A;-ao,0,...,0). (5) 

There are two possible ways for adding a partial sequence containing at least two nodes, but only one possibility for 
adding a sequence with only one node. Thus, analogously to the result above we get the result 

P(a) = 2"°-i(A;- 1)!. (6) 

For the asymmetric TSP, this number has to be multiplied with 2. 

2. Number of true Lin-k-Opts 

When calculating the number of true Lin-Zc-Opts, we need to consider the spatial arrangement of the one-node- 
sequences in the old tour. We have to distinguish between single one-node-sequences, tuples, triples, quadruples, and 
so on, i.e., we have to consider the i-tuples for each i separately. Contrarily, we have no problems with the spatial 
arrangement of partial sequences with at least two nodes. In ordca' to get the number of true Lin-fc-Opts, we want to 
use a trick by artificially blowing up partial sequences with only one node to sequences with two nodes. Let us first 
consider here that there are not only partial sequences with at least two nodes but also isolated partial sequences 
with only one node. (We thus first leave out the tuples, triples, ... of single-node-sequences in our considerations, 
but it does not matter here whether there are any such structures.) We extend one one-node sequence to two nodes 
by doubling the node. Thus, one gets T(ao -|- l,ai — 1, . . .) possibilities for performing a true Lin-fc-Opt instead of 
T(ao7 OLii ■ ■ •) possibilities. By changing the direction of this blown-up sequence, one can connect it - in contrast to 
before as it consisted of only one node - to those nodes of the neighboring parts to which it was connected before. 
There are two possibilities to connect it this way to one of the two neighboring partial sequences and one possibility 
to connect it this way to both of them. But these cases are forbidden, such that we have to subtract the number of 
these possibilities in which they get connected and we achieve the recursive formula 

^(^) = ^( T(ao + - l,a2, 
-2 T(q:o, ai - 1, ^2, • • •) 

— T(q:o — 1, Qi — 1, ^2, 

Please note that the resulting number has to be divided by 2, as a partial sequence with only one node cannot be 
inserted in two different directions. 

Analogously, one can derive a formula if there are tuples of neighboring sequences with only one node each. Here 
one expands one of the two partial sequences to two nodes, such that there is one tuple less, but one isolated one- 
node-sequence more and one longer sequence more. Analogously to above, the false possibilities must be subtracted 
and the result divided by 2, such that we get the formula 

T(a) = ^( T(ao + l,Q!i-hl,a2-l,Q!3,---) 

- T(ao,Q!i -I- l,a2 - 1,q;3, . . .) (8) 

- T(ao + 1, ai, ^2 - 1, as, . . .) 

- T(ao,ai,a2 - l,a3, . . .)). 



(7) 
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TABLE II: Number of possibilities for cutting the tour of a traveling salesman if each partial sequence shall contain at least 
two nodes: k denotes the number of cuts of the Lin-fc-Opt, C{k) the number of possibilities. 



k 


C{k) 


2 


N x{N - 


3)/2 






3 


TV X (TV - 


4)(TV- 


5)/3! 




4 


TV X (TV- 


5)(TV- 


6)(TV 


- 7)/4! 


5 


TV X (TV- 


6)(TV- 


7) (TV 


~8)(TV-9)/5! 



For all longer groups of single- node-sequences, like triples and quadruples, there is one common approach. Here it 
is appropriate to blow up a single-node-sequence at the frontier, such that the following recursive formula is achieved: 



Tia) = -( 



n 


ao -1- 1, ai. 


■ ■ ■ .Oii-l 


-f 1, ckj - 


1, 




Qfj+l, . . .) 










ao, ai, . . . , 


ai~i + 1, 


ai - 1, 






ai+i, ■ ■ •) 








n 


ao + 1, ai. 


■ ■ • , 


■f 1, a^-i 


, - 1, 




a^+i, . . .) 










ao, ai, . . . , 


ai-2 + 1, 


ai-i,ai 


-1, 




a%+i, ■ ■ ■)) 









Generally, one should proceed with the recursion in the following way: first, those non-zero a^ should vanish for 
which i is maximal. This approach should be iterated with decreasing i until one ends up for a formula for tours with 
partial sequences consisting of at least two nodes each for which we can use the formula for the special case. 

VI. NUMBER OF POSSIBILITIES FOR CUTTING THE TOUR WITH A LIN-fc-OPT 

A. Special Case 

After having determined the number of possibilities to reconnect partial sequences to a closed tour with a true 
Lin-Zc-Opt, we still have to determine the number of possibilities for cutting the tour in order to create these partial 
sequences. We again start out with the special case in which every partial sequence to be created shall contain at 
least two nodes. By empirical going through all possibilities, we found the formulas which are given in Tab. ^ From 
this result, we deduce a general formula for the possibilities C(fc) for the Lin-fc-Opt: 

C(.)=TVxn(TV-fc-)xl^^x(^-^) (10) 

Thus, we find here that the neighborhood created by a Lin-Zc-Opt is of order 0{N*'). 

B. General Case 

In the general case, an arbitrary Lin-fc-Opt can also lead to partial sequences containing only one node. Here we 
have to distinguish between various types of cuts: The cuts introduced by a Lin-Zc-Opt can be isolated, i.e., they are 
between two sequences with more than one node each. Then they can lead to isolated nodes which are between two 
partial sequences with more than one node each, and so on. Let us view this from the point of view of the cuts of the 
tour. All in all, a Lin-A:-Opt generally leads to k cuts in the tour. Let us denote an i-typc multicut (with 1 < i < k) 
at position j (with 1 < j < TV) as the scenario that the tour is cut at i successive positions after the node with the 
tour position number j. Thus, the tour is cut by an i-type multicut successively between pairs of nodes with the tour 
position numbers (j, j + 1), (j 1, j + 2), . . . , (j + z - 1, j i)- 

Furthermore, let Pi be the number of i-type multicuts: /3i is the number of isolated cuts. is the number of 2-type 
multicuts by which the tour is cut after two successive tour positions such that a partial sequence containing only one 
node is created, surrounded by two sequences containing more than one node. Thus, (32 is also the number of isolated 
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TABLE IIL Number of possibilities for cutting the tour of a traveling salesman: k denotes the overall number of cuts performed 
by the Lin-fc-Opt, /3i, P2, Ps, and /34 denote the number of 1-, 2-, 3-, and 4-type multicuts as defined in the text. Only /3i-values 
for i < 4 are considered here in our examples. For the Lin-6-Opt, only some special cases are considered. The number C of 
possibilities depends on all these numbers. All these formulas for C{/3) were found by hand. 
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Pi 


02 


/33 


134 
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2 











N X 


(iV 


-3)/2 











1 








N 
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3 











N X 


(N 


-4)(iV- 


5)/3! 
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N X 


{N 


-4) 
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N X 


{N 


- 5)(^- 


Q){N - 


7)/4! 
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N X 
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- 5)(N - 


6)/2 
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N X 


{N 
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N X 
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8)(iV-9)/5! 
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N X 


{N 


-6){N - 
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N X 
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N X 


{N 


^7){N- 


8){N- 
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N X 
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8)/3! 
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1 





N X 


{N 
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8){N- 
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1 





N X 


{N 


-7m- 


8) 












2 





N X 


(N 


-7)11 








2 
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N X 


{N 


-7)iN- 


8)/2 









1 





1 


N X 


(N 


-7) 







nodes surrounded by longer sequences and is thus identical with ai. Analogously, 3-type muhicuts lead to tuples of 
nodes which are surrounded by partial sequences with more than one node, thus, P3 is the number a2 of these tuples. 
Analogously, 4-type multicuts lead to triples of sequences containing only one node each, and so on. Generally, we 
have for alH > 1 that 

ai = Pi+i (11) 

of the last section, but for i — Q the situation is different: each i-type multicut produces a further sequence consisting 
of at least two nodes, such that we have 

fc 

i=l 

Please note that ao is both the number of these longer partial sequences and the number of all i-type multicuts. The 
overall number k of cuts can be expressed as 

fc 

= (13) 

i=l 

In this general case, the number C of ways of cutting the tour also depends not only on fc, but on the entries of 
the vector /3 = (/3i, /32, • ■ ■ , /3fe)- As Tab. IIIII shows, the order of the neighborhood size is now given as 0{N°'°). From 
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these examples in the table, we empirically derive the formula 



C(/3) X Y[ {N~k-i)x — (14) 



Ha 



for the number of possibilities for cutting a tour with a Lin-Zc-Opt, leading to Pi many ?-type multicuts. Please note 
that if the upper index of a product is smaller than the lower index, then this so-called empty product is 1. This 
formula can be rewritten to 

1=1 

making use of ao being the sum of all Pi. Please note that Eq. H10|l for the special case with each sequence containing 
at least two nodes is a special case of Eq. (|15|l . 

The numbers for cutting a tour in partial sequences in this section were first found by hand for the examples given 
in Tabs. ITU and IIIII then the general formulas were intuitively deduced from these. After that the correctness of these 
fomulas was checked by computer programs up to A: = 20 for the special case and for all variations of the general case. 



VII. QUALITY OF THE RESULTS ACHIEVED WITH VARIOUS MOVES 

Finally, we want to ask which quality of solutions can be achieved with the various moves. Here we concentrate on a 
comparison of the quality which can be achieved by the "power" of the moves only, thus, we do not use some elaborate 
underlying heuristics like those mentioned in the introduction, bnt use the simplest algorithm, which is often called 
Greedy Algorithm, here: starting out from a randomly created configuration cto, a series of moves is applied to the 
system. Each move chooses randomly a way how to change the current configuration ai into a new configuration (Xi+i. 
A move is only accepted by the Greedy Algorithm if it does not lead to a deterioration, i.e., if the length 7^(0-^+1) of 
the tentative new tour is as long as or is shorter than the length TC{ai) of the current tour. After the acceptance of 
the move ct; — > Ci+i, the system tries to move from the configuration <7i+i to a new configuration. In case of rejection 
of the move ctj —> (Xi+i, one sets (Ji+i = ai and proceeds as above. 

Table IIVI shows the minimum, maximum, and average quality of solutions which can be achieved with the various 
moves for five different TSP benchmark instances which were taken from Reinelt's TSPLIB95 2^ and which vary in 
size between N — 127 and N — 1379. In order to be quite sure to end up in a local minimum, we used 50 x N'^ move 
trials if using either the Exchange or the Node Insertion Move or the Lin-2-Opt. If comparing the results achieved 
with these small moves, we find that the Lin-2-Opt leads to the best results and the Exchange leads to the worst 
results, a result which is in accordance with the theoretical derivations in |34j . Now one can also mix these moves in 
the way that a general move routine calls each of these three moves with equal probability. The next line in Tab. IIVI 
shows that the results, which were taken after 150 x iV^ move trials, are better for this mixture than for any of the 
three moves themselves. This is of course due to the larger neighborhood size of this mixture. 

Then we provide the results for the four variants of the Lin-3-Opt, for which the results were taken after 10 x 
move trials (A few test runs froze after 1 — 2 x move trials), and for a mixture (Here we call each of the four 
variants with equal probability), for which the results were taken after 20 x move trials. If we denote the tour 
position numbers after which the tour is cut by the Lin-3-Opt as i, j, and k with i < j < k and their successive tour 
position numbers as 7+, and fc+, we can write the cut tour as follows: 

... a{i)\a{i+) ... a{j)\a{j+) ... cr(fc)|cr(fc+) ... 

Please note that the tour is of course closed, such that the partial sequence starting at cr(A:_|_) ends with cr(i). If j ^ i+, 
k 7^ and i =/= fc+, there are four possibilities to reconnect the three partial sequences with a true Lin-3-Opt: 



L301: . 


.. aiz) 




. a{k) 


a{i+) . 




a{k^ 


-) 


L302: . 


.. a(^) 




■ CT(i+) 


a{k) . 


■ <y{U) 


a{k^ 


-) 


L303: . 


.. a(^) 


■ 


. a{k) 


<J) ■ 


■ cr(i+) 


c^(fc^ 


-) 


L304: . 




a{k) . 




cr(j+) . 


■ <3) 


a{k^ 


-) 
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TABLE IV: Results for the Greedy Algorithm using small moves (Exchange, Node Insertion Move, and Lin-2-Opt) and the 
variants of the Lin-3-Opt: for each instance, 100 optimization runs were performed, starting with a random configuration and 
performing a specific number (given in the text) of the corresponding move. 
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TABLE V: Results for the Greedy Algorithm using two types of Lin-4-Opts: for each instance, 100 optimization runs were 
performed, starting with a random configuration and performing A'^* times one variant of the Lin-4-Opt with the Greedy 
acceptance criterion. As the computing time is rather large, only small instances are considered. 



instance 


move 


minimum 


maximum 


mean value ± error 


BEER127 


L401 
L402 


123767.073 
121407.255 


134986.024 
131300.030 


129588.275 ± 244.2 
125622.863 ± 214.7 


LIN318 


L401 
L402 


45184.3246 
44539.2015 


48569.5839 
46932.1063 


46740.9896 ± 72.2 
45451.7793 ± 48.3 


PCB442 


L401 
L402 


55673.1534 
53793.3942 


58855.2662 
56843.4938 


57381.3213 ± 71.3 
55209.2331 ± 64.0 



Table IIVI shows that there are some differences in the qualities of the results achieved with the four variants of the 
Lin-3-Opt and that the mixture provides the best resuhs for the three smaller instances, whereas two variants are on 
average better than the mixture for the instances with N = 532 and N = 1379. Comparing these results with the 
results for the small moves, we find that the four variants of the Lin-3-Opt lead to a much better quality of the results 
than the small moves, which is in accordance with the results in |33 |. As Stadler and Schnabl already mentioned 
in this better quality of the results has to be expected because of the much larger neighborhood size of the 
Lin-3-Opts. 

Now one can ask why not to proceed and to move on to even larger moves. We implemented two of the 25 different 
variants of the Lin-4-Opt. If denoting the tour position numbers after which the which the tour is cut as i, j, k, and 
I and their successive numbers as i+, j+, and l+, then the cut tour can be written as follows: 



... a{i)\a{i+) ... cr(j)|cr(j+) 
Then the move variants lead to the following new tours: 



a{k)\a{k+) ... a{l)\a{l+) 



L401: ... a{i) 
L402: ... cr(i) 



a{l) 
a{l) 



<3+) 
a{k) 



a{k) 



cr(i+) 



<y{3) 



a{l+) 



The variant L401 is sometimes called the two-bridge-move, as the two "bridges" . • . and <T{k+) . . . a{l) are 

exchanged. Table IVI shows the quality of the results achieved with these two variants of the Lin-4-Opt. We find that 
a further improvement cannot be found, the results for the better variant of the Lin-4-Opt are roughly of the same 
quality as the results for the worse variants of the Lin-3-Opt. Thus, leaving the Local Search approach even further 
leads to worse results. 

Of course, using only the Greedy Algorithm, one fails in achieving the global optimum configurations for the 
TSP instances, which have a length of 118293.52. .. (BEER127 instance), 42042.535. .. (LIN318 instance), and 
50783.5475. .. (PCB442 instance), respectively. These optima can be achieved with the small moves and the vari- 
ants of the Lin-3-Opt if using a better underlying heuristic (see e.g. [sollsillSTj l. 



VIII. SUMMARY 



For getting an approximate solution of an instance of the Traveling Salesman Problem, mostly an improvement 
heuristic is used, which applies a sequence of move trials which are either accepted or rejected according to the 
acceptance criterion of the heuristics. For the Traveling Salesman Problem, mostly small moves are used which do not 
change the configuration very much. Among these moves, the Lin-2-Opt, which cuts two edges of the tour and turns 
around a part of the tour, has been proved to provide superior results. Thus, this Lin-2-Opt and its higher-order 
variants, the Lin-A;-Opts, which cut k edges of the tour and reconnect the created partial sequences to a new feasible 
solution, and their properties have drawn great attention. 

In this paper, we have provided formulas for the exact calculation of the number of configurations which can be 
reached from an arbitrarily chosen tour via these Lin-fc-Opts. A specific Lin-Zc-Opt leads to a certain structure of 
multicuts, i.e., there are isolated cuts, which divide two partial sequences with at least two nodes, then there are two 
cuts just behind each other, such that a partial sequence with only one node is created, which is in between two partial 
sequences with more than one node, then there are three cuts just behind each other, such that a tuple of partial 
sequences with only one node each is created, and so on. The number of possibilities for cutting a tour according to 
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these structures of multicuts is given in Eq. (14). From the numbers of multicut structures, one has then to derive 
the numbers of partial sequences, which are given in Eqs. (10) and (11). Then one has to use the recursive formulas 
(6-8) in order to simplify the dependency of the number of reconnections to only one parameter. Finally, one has to 
use Eq. (3) for getting the number of reconnections for a true Lin-fc-Opt with k new edges. Finally, one has to sum 
up the products of the numbers of possible cuttings and of the numbers of possible reconnections in order to get the 
overall number of neighboring configurations which can be reached via the move. 

At the end, we have compared the results achieved with these moves using the simple Greedy Algorithm which 
rejects all moves leading to deteriorations. We have found that the Lin-2-Opt is superior to the other small moves and 
that the Lin-3-Opt provides even better results than the Lin-2-Opt. But moving even further away from the Local 
Search approach does not lead to further improvements. 
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